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SYMBOLS 



a] 


- nth coefficient in approximating series 

- column of coefficients ap - - - a^ 


c nm 

C 


r oo 

- constant defined by ( 

■'o 

- N by N matrix with elements c nm 


d n 

<8 


f CO 

- constant defined by V ifr <p ^ 

- colunm of coefficients dp - - - - d^ 


E 


- mean square error 


F-(s) 

f D W. F o< s > 
h(t), H(s) 


- prescribed input 

- output of system under test 

- impulse response, transfer function of system under test 


h*(t), H*(s) 


- approximation of impulse response, Approximation of transfer 
function of system under test 


k n 

’ N 


- computer circuit bias measurements 

- number of approximating functions 


s 


- complex variable of Laplace transform 


s n 

T 


- nth pole of H*(s) 

- averaging time 


W 


- power per unit bandwidth 


o n 


- negative real part of nth pole 




- distance of nth pole from origin 


@n(-) 


- nth approximating function in f*(t), IJ(s) 


A n 


- all pass function with poles of the nth orthonormal function 


o~ 


- standard deviation 


r 


- variable, of integration, argument of correlation function 




- nth approximating function in h*(t), H*(s) 


%(t) 

tat) 


- auto-correlation function of ij(t) 

- cross-correlation function of f-(t) and f Q (t) 
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SYSTEM APPROXIMATION USING 



ORTHONORMAL FUNCTIONS 
INTRODUCTION 

Experimental determination of the dynamic characteristics of a linear 
system is often desirable both in the analysis and the design of control systems. 
The classical method of measuring a linear system transfer function is to ob- 
serve system response to an artificial disturbance, such as a sinusoidal or step 
input. A more general and often more practical approach is made possible 
through the use of statistical methods, which make use of random inputs. Through 
the use of such inputs actual operating records may be used in determining 
transfer functions. 

The purpose of this study is to investigate one statistical method of 
measuring linear system transfer functions. Based on minimization of the mean 
square error, a finite series will be chosen to approximate the system transfer 
function. The terms of this series will be a set of orthonormal functions, the 
coefficients of which are determined by statistical methods. However, no direct 
computation of correlation functions is necessary. 

No attempt will be made in this work to determine the characteristics of 
any particular unknown system, since this is only intended to be a feasibility 
study of the proposed method. Two known second order systems will be investi- 
gated, by approximating their transfer functions with a set of four orthonormal 



functions. 
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In order to simplify the mathematics and mechanization, a white noise 
source is used as input, although the method would work equally well for any 
other statistically describable input with suitable generalization. 



The choice of an error measure in forming the series representation is 
basic to the method used. Throughout this study minimization of the mean square 
error will be the criterion. Other error measures, such as magnitude of error, 
are possible and may in some instances be preferable, but the mean square error 
approach allows a convenient mathematical description of the problem. 

Before proceeding with the theoretical development, certain statistical 
measures must be defined. In a stationary random signal the time dependent 
signal itself cannot be defined, but a statistical measure known as its auto- 
correlation function can. The auto-correlation function is, mathematically, 



Two distinct signals may be correlated using the same technique. This 
defines the cross-correlation function between the tw’o signals to be 



The transfer function of a system, or equivalently its weighting function, 
may be found, having only the above statistical descriptions of its input and out- 
put. This is shown in the following development, as outlined in Ref. 1. An 
alternate method is shown in Ref. 2. 



THEORY 



7 




( 1 ) 



T 




( 2 ) 



Let f^(t) be the input and f Q (t) be the output of a linear system with weighting 
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function h(x), 
then 



p»cc> 

i c tU =• \ h(x) -ft (t-x) dx 

-CD 



( 3 ) 



and 



~ti 0 CT) - ovg -flit) fo (t+T) = avg fitt-T) f 0 (t) 



(•i) 



Substituting for f o (t) 



*V7 0 (?•) = a«/^ \ htt) fi (t-X) dx 

J -co 



Changing the order of integration 

^-too 



= \ h(x) dx avg fc(t-x) 

J -oo 



But, by definition 



-^c(T--X) = QVCj fi(t-T) k(t-X) 



Therefore 

rtOO 

~dio(.T) = \ h(x) Vkcr-x) dx ( 5 ) 

^00 

Solution of the convolution integral of Eq. 5 is simplified if the input signal 
is white noise, meaning the signal has constant power per unit bandwidth (W). In 
this case the auto-correlation function is an impulse of strength W at 0, 
Solution of Eq. 5 is then simply 



( 6 ) 



Tio(r) ~ w hit) 



or 



h(T) %&) 
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Thus, with a white noise input the system weighting function is directly proportional 
to the cross correlation function, the constant of proportionality being the recipro- 
cal of input power per unit bandwidth. The procedure is therefore reduced to 
determining cross-correlation between input and output signals of the system 
under test. 

Before explaining the proposed method of accomplishing this determination, 
it might be well to mention some of the more widely used techniques available. 
Correlation functions may be calculated directly from the definition. This involves 
multiplication, summation and averaging over a reasonably long period of time, 
one of the multiplicands being delayed a certain time, . The MIT electronic 
correlator mechanizes the above procedure, calculating the correlation function 
at discrete values of the argument (Ref. 3). Either an analog or a digital 
computer may be used in the calculations, although a digital computer is normally 
preferred because of the ease in programming a delay in a multiplicand. 

Some thought on the methods above shows an inherent disadvantage. Be- 
cause discrete values of the argument 7* must be used in calculating correlation 
functions, a continuous curve is not obtainable; and hence no functional description 
of the correlation functions is obtained by these methods. 

The method considered in this study is intended to overcome these limi- 
tations. An entirely different approach is used, in which an attempt is made to 
obtain a series representation of the entire correlation function over all values 
of T rather than obtain specific values for discrete 7~ . Thus the correlation 
function is defined functionally for any 7* with arbitrarily small error depending 
upon the goodness of the approximating series. The measure of approximation 
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error using this method will not be in the number of values computed, but 
rather in how well the series approximates the true correlation function. 

It was shown above that the desired system weighting function is directly 
proportional to the cross correlation between input and output when the input is 
white noise. The cross-correlation function will be approximated by 



The frequency expression equivalent to Eq. 8 provides an approximation of the 
system transfer function. 



In the above equations are approximating functions and a n are the 

coefficients of these functions. The choice of approximating functions is obviously 
of primary importance, and should be based on what knowledge of system behavior 
is available. A judicious choice of <£ n U>) will reduce the number of series terms 
required for a certain accuracy. No attempt will be made to set up rules or 
techniques for such a choice, since this study deals with method feasibility after 
a proper choice of $,(si has been made. A discussion of the factors involved in 
choosing may be found in Ref. 4. A greater number of approximating functions 
will of course make possible a greater accuracy, the number being limited by the 







and, from Eq. 6, 




( 8 ) 




( 9 ) 



complexity allowed. 
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Having decided upon a set of approximating functions, the coefficient of 
each can be found on the basis of minimum mean square error. This mean 
square error is 

£ to, 4 j.ro T dt < 10 > 

Expanding 

E" G'w dt (ho + £_ £. o„a G/t) <Pjt> <# 

J 0 1*' J 0 n» = i ) 



For simplification, define 



dh 




and. 



dt 

J o 



(ii) 



Substituting 




/V 

~ 2. Qr, °h "t ^7 C nm 



( 12 ) 



To minimize the above with respect to a n , set 



M: 

* 0 * 



0 o -2-d^ + 2. zL_ dm c nni 



n* 1,2, w 



( 13 ) 



or, 



d„ = L 

m=i 



•vw 



Qtn 



», 2 ., N 



( 14 ) 



This is a set of N linear equations: 



d^c.a. + c^a^ ••• +c, N a M 

i 

i 

i 

i 

q^-t- • +c hN 0. N 



( 15 ) 
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In matrix notation 



d]=C^ 



or 



a] - C ' d] 



( 16 ) 



It has been shown (Ref. 4) that the minimum so obtained is unique and is the 
system minimum, provided both the and Eqs. 15 are linearly independent. 
If the approximating functions are chosen to be orthonormal, that is 



This error is due solely to the finite series approximation and will always be 
present when using this method. 

Eq. 18 is the theoretical basis for analog computer determination of the 
finite series coefficients. Substituting in this equation the expression for the 
cross-correlation function from Eq. 4 yields 



Note that T is not permitted to approach infinity in the above equation. For the 
remainder of this development a finite averaging time will be assumed. Inter- 




im 



(17) 



o 



- 0 



the square matrix "C” is the identity matrix, and, 




dt 



(18) 



The mean square error is then 




(19) 




o 



o 



( 20 ) 



changing the order of integration, 
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Let 0„(t) represent the output of a linear system with impulse response 
and input f^, then, 

Q n = T \ dt (21) 

o 

in which 

r°° 

e„w»\fut-ti un dr < 22 > 

J o 

Eq. 21 can be mechanized as shown in Fig. 1, a white noise source being 
used. The figure shows the method of obtaining one coefficient, others could be 
obtained in the same manner. Since all series coefficients can be determined by 
the computer mechanization, and since the <^L>) have been chosen, no additional 
mathematical development is necessary in determining the finite series. 
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FIGURE 1 

Measurement of Orthonormal Function Coefficients 
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Although the above analysis has been restricted to the time domain, the 
results are available in the frequency domain as well. By Eq, 9, using the 
same a n found above to multiply • 1111 approximation to the system transfer 

function is immediately available. 

After the coefficients have been determined, each of the orthonormal 
approximating functions of the computer circuit can be multiplied by its proper 
coefficient, and thus the system under test can be simulated. That is, an impulse 
can be applied to the set of approximating functions, their outputs summed and 
plotted to form a graphical representation of the approximate system weighting 
function. This procedure is illustrated in Fig. 2. 
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FIGURE 2 

Simulation of H * (s) 
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ORTH ON ORMA L FUNCTIONS 

As orthonormal functions greatly simplify coefficient determination, it 
would be desirable to have some means of obtaining a set of these functions that 
would not only permit a wide selection of approximating functions but also be 
amenable to simulation by analog equipment. 

By using the theory of residues, Ref. 3 develops a set of orthonormal 
functions that meet these requirements. Starting with a set of linearly inde- 
pendent transfer functions, , it is possible to obtain a set of functions, 

• such that, in addition to orthonormality, 

$2.CS! = ) 

( 23 ) 

S CS) = -f 3 ($,fc ) } $p) ) 

* I 

I < 

i i _ 

$n (s) = ) 

If the linearly independent functions, , have real poles at s n = - Oi n » 
and complex poles at 

So.thi ~ ” - j ^ — ( ''* n 



the orthonormal functions become 



AS) 



= A 

'n-i 



jZC<n 

S+ctvi 



for real roots, and 






<| tel = A. (s! 

'VH 



_2pL 5 

S % +2« w S+(^n 



(24) 
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for complex roots, where 



A (a = feaxsisa 



(’V*- & » - > 1 

Cs 



(25) 



Ref. 3 also shows that the analog circuitry necessary to realize these functions 
is 
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ERRORS 

The discussion up to this point has assumed ideal components. It would 
be relevant at this point to consider some of the errors and equipment limitations 
that would be present when the system is mechanized and relatively short 
averaging times are used. The errors may be divided into three groups: those 
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due to biases in the electronic components, those due to the non-linearities of 
the servo multipliers, and those due to the use of finite averaging times. 

Static Error Analysis 

In order to study the effect of biases, the circuit shown below in Fig. 4 will 
be used. 




FIGURE 4 



Schematic Showing Assumed Static Errors 



l 



Here k^ may be thought of as an essentially constant bias on the input, fj ; i< 2 
and k„ as constant biases in the circuitry making up H(s) and 4^'^ . re- 
spectively; and k^, a constant, as the combined effect of servo multiplier static 
error and bias in the integrator following the multiplier. It should be noted that 
H(o) and (^(o) are the DC responses of H(s) and <4> rt C>) , respectively. 

Then the output of the multiplier would be 

Uo + k,Hto) . 
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If a* is now defined as the coefficient computed by the circuit in Fig. 4, the 
error in a* may be evaluated by noting that 

<£ = fC k 4 )cft ( 26 > 

and 

3 n = T \ dt 

o 

so 

t ^ r 

~ a n * f \ L-ikA^ + ^ok 5 + 9 n k, M(oi f Choo) +k^© n 

k, k,$^o)+ k, k^Hco-i-v k z kj- k 4 l dt 

Ii r I is large enough, the finite time average values of the random functions 
and f will be essentially zero, which gives 

- t \ k* H(f» $^o> + K. k 3 Hto) +U,k x +kj^4 k,]dt (27) 

J o 

But the average value of a constant is the constant itself, so that 

Q*“ 4 n - k* H(<h $ r ts>) + k. k, Hw) 4 k Ml 4 ‘k i Uv 4 R 4 (28) 

1 he mechanization of orthonormal functions previously described gave two 
types of functions, a constant divided by a quadratic in s, and a constant multi- 
plying s divided by a quadratic in s. For the latter case, the DC response is 
zero, or d> (o) = o . and 
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a„*-a„ = +kj,k 3 + k 4 (29) 

Further application of these results will depend upon the hardware being 
used. k 2 , k^, and k^ may be measured more or less directly, and dt 

With a properly adjusted noise source, kj should be of the same order of magnitude 
as k 2 and k^; the use of good servo multipliers should assure that k^ would be of the 
same order of magnitude as the other perturbation voltages. Thus if second order 
effects are neglected, Eq. 28 becomes 

a* -a, = k, < 30 > 

Servo Multiplier Limitations 

The preceding analysis treated errors that were electronic in origin, the 
next source of error to be considered is the servo multiplier. As used in system 
approximation, f is used to drive the shaft, which positions a potentiometer arm, 
and 9 n is fed into the potentiometer winding. 

While the multiplicand will be reproduced on the potentiometer without time 
delay, the multiplier, on the other hand, may be subject to both a time delay and 
a dynamic position error due to the inertia of the servo and the finite torque 
available from the motor windings. 

The servo specifications are usually given in the form of a limiting position 
(volts), a limiting velocity (volts/sec), and a limiting acceleration (volts/ sec"). 

If T is the applied torque, 0 O the output displacement angle, I the inertia of the 



mechanism, and f the viscous friction, 
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t=I 9 0 a 



( 31 ) 



But the specifications are in the form 




so it is possible to be within the specified velocity and acceleration limits and 
still exceed the servo motor's capabilities because the combined torque require- 
ments are greater than T 

b max 

If the input to the servo shaft is a sine wave of known magnitude and 
frequency, it is fairly easy to determine whether or not the input is beyond the 
capabilities of the servo. If the input is more complex, however, the only infor- 
mation available may be an estimate of the bandwidth of the input signal and the 
power per unit bandwidth of the input signal. 

If the effect of the drifts and biases throughout the circuitry is to be kept 
to a minimum, the signal level should be kept as high as possible. A calculation 
of the maximum allowable signal can be made if an estimate of the filtering 
properties of the system between the input and the servo shaft is available. 

Thus if II* (s) is the estimated approximation of H(s), and Vv(eo) is the noise power 
per unit bandwidth, the square of the standard deviation of f in terms of position, 
velocity, and acceleration may be found from 




J 



( 32 ) 
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, respectively. 



Quite often the assumption that 

W — W for - 10 C < u) < tA, 

= 0 elsewhere 

may be made without greatly harming the accuracy of the calculations, and 
thus the integrals above become 



which may be evaluated by numerical methods to give these deviations as a 
function of and W, the noise power per unit bandwidth. If the variances 
obtained are multiplied by four and set equal to the respective servo limits, values 
of and W will be found which, for Gaussian distributions, will saturate the 
servo less than . 006% ofthe time, thereby eliminating a potential source of inaccu- 





( 33 ) 




racy. 
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Effect of Finite Averaging Times 

As the voltage to be averaged in the mechanization of this method of system 
analysis is the product of two essentially random functions, the product is random 
itself, and a statistical description is the best that could be expected. It can be 
shown that the expected deviation is given by 

Qq-t _ /.5~ 77 (34) 

a? T 

where is the time constant of the approximating function, and T is the averaging 
time in seconds. 

The maximum averaging time allowable is a function of the multiplier out- 
put level and the saturating voltage of the integrator used in the averaging. To 
minimize the effects of the biases previously examined, the signal level should 
be as high as the servo multiplier limitations will permit. Since it can be 
assumed that the errors due to finite averaging times are random, large equiva- 
lent averaging times may be attained by summing the voltages and times for many 
short runs. 



COMPUTER MEASUREMENTS 

Computer work connected with this study was undertaken for the purpose of: 

1. Verifying the analytical development. 

2. Investigating difficulties which may be encountered in the application of 
the theory. 

3. Verifying the error analysis. 

4. Reaching a conclusion as to the feasibility' of the proposed method of 
measuring system transfer functions. 
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The computer laboratory work may be divided into four main efforts; 

1. Setting up and calibrating the noise source. 

2. Mechanizing the orthonormal approximating filters. 

3. Mechanizing the systems to be studied and obtaining the required co- 
efficients. 

4. Simulating the systems under study with the approximating filters. 

Computer equipment available included two drift stabilized 16 amplifier 

Michigan analog computers and one portable 20 amplifier Michigan analog 
computer. 

Noise Source 

Because it greatly simplifies computation, white noise was used throughout 
as the input for the analog computer simulation. White noise may be defined as 
a signal with constant power per unit bandwidth (W) over all frequencies. Physical 
limitations require that a real white noise source be limited in bandwidth. The 
assumption is made that as long as the power per unit bandwidth is constant over 
considerably more than the frequency range of interest in a particular problem, 
then the noise may be considered white for that problem. 

In the computer work for this study, systems under test were used which 
had cut off frequencies near one cycle per second. With this in mind it was 
considered sufficient to supply a noise source with an upper cut off frequency of 
approximately 3 cycles per second. 

The General Radio noise generator used procudes Gaussian white noise 
over a frequency range from 30 cycles per second to 20, 000 cycles per second. 

In order to obtain the desired input frequencies, the noise generator output was 
put through a gating and filter network, mechanized on a Michigan 20 amplifier 
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FIGURE 5 

Noise Filtering Circuit* 



! 



computer. As shown in Fig. 5 the noise was first gated at approximately 200 
cycles per second, which by sampling theory introduces beat frequencies in the 
lower end of the frequency spectrum. This gated signal was then sent through 
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a high pass filter with a lower cut off frequency of . 02 radians per second, which 
removed the DC bias caused by gating. Finally a third order Butte rworth low 
pass filter with a cut off frequency of 20 radians per second attenuated the higher 
frequency power. The resulting noise source was essentially of constant pow'er 
per unit bandwidth over the frequency range which was used. 

Under the assumption that the power per unit bandwidth was constant, its 
value was measured as shown schematically in Fig. 0. The procedure was to 
obtain the total power output of the low pass filter shown, by squaring and 
averaging its output. This total power may be equated to the power per unit 
bandwidth (W) at a certain frequency, multiplied by the filter gain squared 
at that frequency, and integrated over all frequencies. Since the power per unit 
bandwidth is assumed constant, the total power integral may be written as 




( 35 ) 



Noi.s>e 

Sous ce 



i 
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FIGURE 6 

Noise Power Per Unit Bandwidth Measurement 
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Equating the total power as measured in Fig. G to the total power from 
Eq. 35; 



avg 



z W 
x ~ 27\ 



dco 



l +.25-01* 






(36) 



Because a significant time variation in noise source voltage was noticed, a power 
measurement was made with each averaging run throughout this study. 
Approximating -Functions 

A set of four second order orthonormal approximating functions was 
mechanized as shown in Fig. 7. The four functions were: 



#,CS) = 



z f± s 

S s +.6S + t 




zfA 
s v .as + 1 




(St 4)h| 

(s-.^r+i 



S 

S l + l.6S t I 



' (S-.4t-f| 



s'+ias-*-! 



(37) 



in which 



= | - a 3 = . 6,^-1 



The weighting function of each of the above was obtained by supplying an 
impulse to the system. These weighting functions are plotted in Figs. 8 and 9. 

A schematic representation of how these functions were used is shown in Fig. 10. 
Note that in measuring a system function in accordance with the theoretical 
development, it is intended to have the system output on the shaft of the servo 
multipliers. However, it was desirable here to first verify the orthonormality 
of the approximating functions, and in so doing obtain a feeling for the expected 
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aeeuraey of the procedure. This simply involved using the output of one of the 
orthonormal filters to drive the servo shaft, i. e. h , and putting all 
four filters on the servo potentiometers. Eqs. 17 and 18 show that the coef- 
ficient of the function fed to the shaft, multiplied by itself, integrated, and 
averaged, should be the noise per unit bandwidth, W. Eqs. 17 and 18 show that the 
other three coefficients should be zero. Averaging times of 1000 seconds were 
used in these runs, and the results, normalized with respect to W, are tabulated 
in Table I. For the ease where the output of <|, (s) is on the shaft, Fig. 11 is a 
plot of error in experimental results against time, showing error as a percentage 
of a. . 

Table I. 

Experimental Coefficients for Orthonormal Cheek of 
Approximating Functions 



— 


F mictions Replacin 


ig H(s) 










$,<*) 


a l 


.985 


. 005 


.029 


. 007 


a 2 


. 003 


.962 


. 023 


. 070 


a 0 

o 


. 019 


. 148 


. 922 


. 008 


a 4 


. 028 


. 009 


. 008 


.984 



Static error measurements were read as 

k, = .i€> Volts , .15 Volts J J5 Volts ^ ^ = 2. Mo" 4 Volts . 

Using these static errors in Eq. 29, and an averaging time of 1000 seeonds in 
Eq. 34, a predicted error of 5% was obtained. The results of Table I seem to 
conform fairly well to this predicted error. 
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Systems Under Study 

Since this work is limited to a feasibility study, no unknown system was 
investigated. Rather two known systems were used for H(s), so that the quality 
of the approximation could be checked. The systems were 

H,cs)- s^TsT^ ; H a C5) = s%. s + .5 < 38 ) 

Note that the poles of these systems are, in s-plane representation, at 
-. 5 +■ j. 5, as compared to -. 4+ j. 92 and —.8 ± j. G for the approximating functions. 
Because the approximating functions have no poles coincident with the systems 
under study, and a finite number of approximating functions are being used, there 
must be some error in the approximations. The object was to find the set of co- 
efficients which gave the least mean square error approximation to each of the 
systems. 

The desired coefficients were found analytically by the method of residues. 
Evaluation of the residues resulted in columns one and three of Table II. Columns 
two and four of this table contain the coefficients found experimentally using the 
circuit shown schematically in Fig. 10. 



Table n. 

Calculated and Experimental Coefficients for H|(s) and H^(s) 



1 


1 H 1 (s) 


H 2 (s) 




Calculated 


Experimental 


Calculated 1 


Experimental 


a l 


-. 145 


-. 137 


.971 


1 . 0 


a 2 


.521 


.568 


-. 228 


- .209 


a 3 


092 


-.016 


182 


- .158 


a 4 


-.456 


-.476 


-.660 


- .584 
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After the coefficients were determined, the original systems were simulated 
by the approximating filtex's, weighted propei'ly. Figs. 12 and 13 show the 
weighting functions of the linear second oixler systems, the simulated weighting 
functions using analytically determined coefficients, and the simulated weighting 
functions using experimentally determined coefficients. Note that the most serious 
eri'or in both cases was caused by the poor correspondence between the approxi- 
mating filters and the systems being studied. A greater number of approximating 
functions, or adjustment of the poles of these functions, would reduce this error. 
The error due to finite averaging times and component inaccuracies was compara- 
tively small, that is, the calculated and experimental approximations are fairly 
close to each other. 

Limitations 

The computer work brought out some serious limitations on this method of 
measuring system transfer functions. 

1. Electronic error considerations showed the necessity of using only drift 
stabilized amplifiers both in the approximating filter circuit and as 
averaging integrators. 

2. The most severe limitation was imposed by the servo multiplier. The 
cut off frequency of the system under test had to be kept at approximately 
five cycles per second or less in order not to exceed servo velocity 
limitation. The velocity limitation also dictated that the filtered noise 
source be limited to a fairly narrow bandwidth. A twenty radian per 
second bandwidth was used successfully in this work. A two hundred 



radian per second bandwidth was tided but was found to cause servo 
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overload by exceeding the velocity power limit. Because the systems 
were limited to low cut off frequencies, long averaging times were 
required. 

3. The question of pole optimization in choosing approximating functions 
was not considered in this study. It should be noted that with the 
arbitrary choice of poles made here, the approximation is of little 
real use. For accurate approximation a better choice of pole locations, 
coupled with an increase in the number of the approximating functions, 
is necessary. 



CONCLUSIONS 

The proposed method of measuring system transfer functions was found to 
be feasible within limits. In order to make accurate measurements on an actual 
unknown system, the electronic equipment available must include drift stabilized 
amplifiers and electronic multipliers capable of handling multiple inputs. The 
number of amplifiers required is dependent upon the knowledge available on the 
system under study and its complexity. Some knowledge of the system is definitely 
desirable. 

Once the coefficients have been determined, the system under study is easily 
simulated by the approximating network. In this manner an electronic approxi- 
mation to the system under study is immediately available as a component in an 
electronic circuit. 

Although the theory holds equally well for an arbitrary input and for general 
approximating functions, this study has been limited to white noise input and 
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orthonormal approximating functions in order to illustrate the theory involved 
and to carry this theory through a practical development. It is believed that the 
results justify further efforts along this line. 
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FIGURE 10 



Procedure Used in 
Obtaining Coefficients of 
Approximating Functions 
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